Object Recognition System for the Visually Impaired: A Deep Learning Approach using Arabic Annotation
نویسندگان
چکیده
Object detection is an important computer vision technique that has increasingly attracted the attention of researchers in recent years. The literature to date field introduced a range object models. However, these models have largely been English-language-based, and there only limited number published studies addressed how can be implemented for Arabic language. As far as we are aware, generation text-to-speech engine utter objects’ names their positions images help Arabic-speaking visually impaired people not investigated previously. Therefore, this study, propose segmentation model based on Mask R-CNN algorithm capable identifying locating different objects images, then uttering Arabic. proposed was trained Pascal VOC 2007 2012 datasets evaluated testing set. We believe one few uses train test model. performance compared with previous literature, results demonstrated its superiority ability achieve accuracy 83.9%. Moreover, experiments were conducted evaluate incorporated translator TTS engines, showed could effective helping understand content digital images.
منابع مشابه
Deep Learning Autoencoder Approach for Handwritten Arabic Digits Recognition
This paper presents a new unsupervised learning approach with stacked autoencoder (SAE) for Arabic handwritten digits categorization. Recently, Arabic handwritten digits recognition has been an important area due to its applications in several fields. This work is focusing on the recognition part of handwritten Arabic digits recognition that face several challenges, including the unlimited vari...
متن کاملSmartEyes : An Object Identification System for the Visually Impaired
The dawning of the computer era has opened a world of new possibilities and solutions to solving the many challenges faced by the visually impaired in their quest for autonomous living. According to researcher Yasser Ebrahim the visually impaired faces two principal challenges when interacting with their environment. One of which is to sense and identify the objects surrounding them. This is co...
متن کاملthe use of appropriate madm model for ranking the vendors of mci equipments using fuzzy approach
abstract nowadays, the science of decision making has been paid to more attention due to the complexity of the problems of suppliers selection. as known, one of the efficient tools in economic and human resources development is the extension of communication networks in developing countries. so, the proper selection of suppliers of tc equipments is of concern very much. in this study, a ...
15 صفحه اولComputer Vision-based Object Recognition for the Visually Impaired Using Visual Tags
Recognizing generic objects in the surrounding environment is a major challenge for the visually impaired for which few assistive technological solutions have been devised to date. Nevertheless, in recent years, several computer vision-based strategies have emerged for this task which utilize visual tags affixed to objects for identification. These approaches are distinguished by their reliance...
متن کاملDEEP-SEE: Joint Object Detection, Tracking and Recognition with Application to Visually Impaired Navigational Assistance
In this paper, we introduce the so-called DEEP-SEE framework that jointly exploits computer vision algorithms and deep convolutional neural networks (CNNs) to detect, track and recognize in real time objects encountered during navigation in the outdoor environment. A first feature concerns an object detection technique designed to localize both static and dynamic objects without any a priori kn...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Electronics
سال: 2023
ISSN: ['2079-9292']
DOI: https://doi.org/10.3390/electronics12030541